Systems and methods for web analytics testing and web development

ABSTRACT

A computer system for analyzing page tags of a website. The system may include a processor in communication with a database; and a storage medium. The storage medium may store instructions that, when executed, configure the processor to: access the website, the website comprising plurality of page tags; generate a collected tag record by aggregating the page tags, the collected tag record comprising collected elements; request, from the database, a benchmark tag record, the benchmark record comprising benchmark elements, the benchmark tag record being based on historic page tags stored in the database; generate a result tag record, the result tag record indicating at least one of matches or mismatches between the benchmark tag record and the collected tag record; and display at least one of the result tag record or an analysis result, the analysis result representing an aggregation of the result.

TECHNICAL FIELD

The present disclosure relates generally to systems and methods for webanalytics testing and software development, and more particularly to anautomated system for page tag testing and analysis.

BACKGROUND

Web analytics is the measurement, collection, analysis, and reporting ofweb data. Web analytics was originally developed to monitor web data byanalyzing log files or by inserting small scripts or page tags thattrack activity. For example, in some web analytics techniques, a smallJavascript code or “cookie” may be associated with a website to collectvariables such as time spent on a site or the identity of an originatingwebsite. Web analytics techniques, however, are no longer merely used tomonitor web data. Nowadays, web analytics are also actively used tosupport web development projects.

Web development and software engineering is an increasingly complexactivity. Current projects are large and intricate, may require multipleversions or iterations (often being developed in parallel), and may bedeveloped by multiple teams that independently work on specificfeatures. It is not unusual for major web development efforts toexperience delays or failures caused by, for example, unexpectedinteractions between website features. To face these complexities andguarantee accurate control of the project, developers have turned to webanalytics to help monitor the status of a project, compare differentiterations, and evaluate the effect of new features in the overall userexperience. For example, during web development page tags may be used tomonitor whether buttons and links are working properly. Also, a page tagmay track whether a login is successful when a user inputs accuratecredentials and the loading time of a website. This incorporation of webanalytics or metadata analysis in web development has helped developersand managers to monitor projects.

Nowadays, however, projects scale very quickly and the vast amount ofpage tags or metadata associated with a website often prevents theireffective analysis or use during development. For example, it is commonto have hundreds or even thousands of page tags associated with awebsite. Developers and managers must now invest massive resources tomonitor these page tags during development. Indeed, analyzing page tagsassociated with a large website may stress computer resources becauseparsing and filtering tasks are performed in very large data sets,making the analysis processes slow and inefficient. Further, monitoringpage tags often require multiple iterations of analysis for eachsprint/regression cycle. In some situations the analysis of the pagetags may create bottle necks in the development process significantlydelaying a project. The increasing large amount and complexity of pagetags that are associated with a website, can render the use of webanalytics techniques impractical during development, andpost-development evaluation.

The disclosed systems and methods address one or more of the problemsset forth above and/or other problems in the prior art.

SUMMARY

One aspect of the present disclosure is directed to a computer systemfor analyzing page tags of a website. The system may include a processorin communication with a database; and a storage medium storinginstructions that, when executed, configure the processor to: access thewebsite, the website may include a plurality of page tags; generate acollected tag record by aggregating the page tags, the collected tagrecord may include collected elements; request, from the database, abenchmark tag record, the benchmark record may include benchmarkelements, the benchmark tag record being based on historic page tagsstored in the database; generate a result tag record, the result tagrecord indicating at least one of matches or mismatches between thebenchmark tag record and the collected tag record; and display at leastone of the result tag record or an analysis result, the analysis resultrepresenting an aggregation of the result record.

Another aspect of the present disclosure is directed a non-transitorycomputer-readable medium storing instructions. When executed theinstructions may cause a processor to operate a computer system foranalyzing page tags of a website by performing operations. Theoperations may include accessing the website, the website may include aplurality of page tags; generating a collected tag record by aggregatingthe page tags, the collected tag record may include collected elements;requesting, from a database, a benchmark tag record, the benchmark tagrecord may include benchmark elements, the benchmark tag record beingbased on historic page tags stored in the database; generating a resulttag record, the result tag record indicating at least one of matches ormismatches between the benchmark tag record and the collected tagrecord; displaying at least one of the result tag record or an analysisresult, the analysis result representing an aggregation of the resultrecord.

Yet another aspect of the present disclosure is directed to acomputer-implemented method for analyzing page tags of a website. Themethod may include accessing a website, the website may includeplurality of page tags; generating a collected tag record by aggregatingthe page tags, the collected tag record may include collected elements;requesting, from a database, a benchmark tag record, the benchmark tagrecord may include benchmark elements, the benchmark tag record beingbased on historic page tags stored in the database; generating a resulttag record, the result tag record indicating at least one of matches ormismatches between the benchmark tag record and the collected tagrecord; display at least one of the result tag record or an analysisresult, the analysis result representing an aggregation of the resultrecord.

Another aspect of the present disclosure is directed to a computersystem for analyzing page tags of a website. The system may include aprocessor; and a storage medium storing instructions that, whenexecuted, configure the processor to: receive a web address from amodified web browser, the modified web browser may include a page tagcapturing module; access a website associated with the web address viathe modified web browser; generate a collected page tag record using thepage tag capturing module, the collected page tag record including aplurality of collected tags; receive, from the modified web browser, aprobe tag, the probe tag may include a probe identification; determinewhether the probe tag is included in the collected page tag record; anddisplay a coded list may include the collected tags, the coded listassociating collected tags with graphical icons, the graphical iconsrepresenting whether collected properties match the probe tag.

Yet another aspect of the present invention is directed to anon-transitory computer-readable medium storing instructions that, whenexecuted by a processor, cause the processor to operate a computersystem for analyzing page tags of a website by performing operations.The operations may include receiving a web address from a modified webbrowser, the modified web browser may include a page tag capturingmodule; accessing a website associated with the web address via themodified web browser; generating a collected page tag record using thepage tag capturing module, the collected page tag record may include aplurality of collected tags associated with collected properties;receiving, from the modified web browser, a probe tag, the probe tag mayinclude a probe identification; determining whether the probe tag isincluded in the collected page tag record; and displaying a coded listmay include the collected tags, the coded list associating collectedtags with graphical icons, the graphical icons representing whethercollected properties match the probe tag.

Another aspect of the present invention is directed to acomputer-implemented method for analyzing page tags of a website. Themethod may include receiving a web address from a modified web browser,the modified web browser may include a page tag capturing module;accessing a website associated with the web address via the modified webbrowser; generating a collected page tag record using the page tagcapturing module, the collected page tag record may include a pluralityof collected tags associated with collected properties; receiving, fromthe modified web browser, a probe tag, the probe tag may include a probeidentification; determining whether the probe tag is included in thecollected page tag record; and displaying a coded list may include thecollected tags, the coded list associating collected tags with graphicalicons, the graphical icons representing whether collected propertiesmatch the probe tag.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of this specification, illustrate disclosed embodiments and,together with the description, serve to explain the disclosedembodiments. In the drawings:

FIG. 1 is a block diagram of an exemplary system, consistent withdisclosed embodiments.

FIG. 2 is a block diagram of an exemplary local subsystem, consistentwith disclosed embodiments.

FIG. 3 is a block diagram of an exemplary supervisor system, consistentwith disclosed embodiments.

FIG. 4 is a block diagram of an exemplary database, consistent withdisclosed embodiments.

FIG. 5 is a block diagram of an exemplary master server, consistent withdisclosed embodiments.

FIG. 6 is a block diagram of an exemplary client device 150, consistentwith disclosed embodiments.

FIG. 7 is an exemplary flow chart illustrating a page tag analysisprocess, consistent with disclosed embodiments.

FIG. 8 is an exemplary flow chart illustrating a page tag normalizationprocess, consistent with disclosed embodiments.

FIG. 9 is an exemplary flow chart illustrating a page tag searchingprocess, consistent with disclosed embodiments.

FIG. 10 is an exemplary flow chart illustrating a character-based searchprocess for determining presence of an element in a record.

FIG. 11 is an exemplary flow chart illustrating a page tag analysisprocess implemented with a modified web browser, consistent withdisclosed embodiments.

FIG. 12 is an exemplary flow chart illustrating a graphical userinterface generation process, consistent with disclosed embodiments.

FIG. 13 is an exemplary graphical user interface, consistent withdisclosed embodiments.

FIG. 14 is a graph of an exemplary page tag report, consistent withdisclosed embodiments.

DETAILED DESCRIPTION

The disclosure is generally directed to a system that facilitatesanalysis of page tags associated with websites, and creates a secureimplementation of changes. Page tags may include different forms ofmetadata associated with websites. For example, page tags may includeHTML Meta Tags, including title, description, or keywords.

In some embodiments, the system may be arranged with local, mobile, andsupervisor subsystems. These subsystems may be configured toautomatically monitor page tags, compare page tags, and generatereports. In addition, to simplify page tag collection and testing, adeveloper in one of the subsystems may test a website by automaticallyrunning a plurality of scenarios. For each scenario the subsystem maycapture multiple page tags which are then compared to a database of pagetags. To improve speed and accuracy when comparing page tags, subsystemsmay utilize routines designed to improve the computer functionality byutilizing dedicated hardware or specific functions. Additionally oralternatively, subsystems may generate codified reports that describethe overlap of benchmark and collected tags and provide a probability ofsuccess or failure. The system may additionally be used to coordinatechanges executed in a master server. In some embodiments, new featuresor changes are only implemented after a supervisor subsystem issues akey to provide access to a master server. In alternative or additionalembodiments, the system may be configured so only a supervisor subsystemcan contact a master server to minimize errors and have accurate controlover a project. These arrangements create a robust system toautomatically analyze page tags in multiple points on development anduse them to coordinate changes to a website or software.

In addition, in some embodiments the system may employ a modified webbrowser to analyze the page tags on a developed website. The analysismay be based on receiving a probe tag that is compared against, orsearched in, a plurality of collected page tags that are associated witha website that is accessed through the modified web browser.

Reference will now be made in detail to the disclosed embodiments,examples of which are illustrated in the accompanying drawings.

FIG. 1 is a block diagram of an exemplary system 100, consistent withdisclosed embodiments. System 100 may be used to automatically analyzepage tags of a website and implement changes to the website, consistentwith disclosed embodiments. System 100 may include a local subsystem110, a mobile subsystem 120, supervisor subsystem 130, Online resources140, client devices 150, master server 160, databases 180, networkanalyzer 190. In some embodiments, as shown in FIG. 1, some componentsof system 100 may be connected to a network 170. However, in otherembodiments components of system 100 may be connected directly with eachother, without network 170.

Local subsystem 110 may be a system associated with an online contentprovider. For example, local subsystem 110 may be associated with anentity that generates, provides, manages, tests, and/or maintainswebsites and websites. Local subsystem 110 may store information about awebsite; for example, it may include storage devices that comprisesource code and other types of website information known to thoseskilled in the art. Local subsystem 110 may include infrastructure andcomponents that are configured to generate and test websites. Forexample, local subsystem 110 may include computer processors thatcompile websites and databases storing web data. Additional elements oflocal subsystem 110 will be described with respect to FIG. 2.

Mobile subsystem 120 may include similar components to those of localsubsystem 110, having components to generate, provide, manage, test,and/or maintain websites. However, mobile subsystem 120 may be dedicatedto testing mobile applications. For example, mobile subsystem 120 mayinclude components specifically configured to emulate Android and/or iOSenvironments. In some embodiments, mobile subsystem 120 may include awebsite resizer or mobile device tester.

FIG. 1 shows local subsystem 110 and mobile subsystem 120 as differentcomponents. For example, local subsystem 110 and mobile subsystem 120may be in independent physical locations. However, local subsystem 110and mobile subsystem 120 may be implemented in the same computingsystem. For example, local subsystem 110 and mobile subsystem 120 may beembodied in a single server.

Online resources 140 may include one or more servers or storage servicesprovided by an entity such as a provider of website hosting, networking,cloud storage, or backup services. In some embodiments, online resources140 may be associated with hosting services or servers that store otherwebsites. In other embodiments, online resources 140 may be associatedwith a cloud computing service such as Microsoft Azure™ or Amazon WebServices™. In yet other embodiments, online resources 140 may beassociated with a messaging service, such as, for example, Apple PushNotification Service, Azure Mobile Services, or Google Cloud Messaging.In such embodiments, online resources 140 may handle the delivery ofmessages and notifications related to functions of the disclosedembodiments, such as defective page tags or unsuccessful loadings.

Client devices 150 may include one or more computing devices configuredto perform one or more operations consistent with disclosed embodiments.For example, client devices 150 may include a desktop computer, alaptop, a server, a mobile device (e.g., tablet, smart phone, etc.), agaming device, a wearable computing device, or other type of computingdevice. Client devices 150 may include one or more processors configuredto execute software instructions stored in memory, such as memoryincluded in client devices 150. Client devices 150 may include softwarethat when executed by a processor performs known Internet-relatedcommunication and content display processes. For instance, clientdevices 150 may execute browser software that generates and displaysinterfaces including content on a display device included in, orconnected to, client devices 150. Client devices 150 may executeapplications that allows client devices 150 to communicate withcomponents over network 170, and generate and display content ininterfaces via display devices included in client devices 150. Thedisclosed embodiments are not limited to any particular configuration ofclient devices 150. For instance, a client device 150 may be a mobiledevice that stores and executes mobile applications that providefunctions offered by master server 160 and/or online resources 140. Incertain embodiments, client devices 150 may be configured to executesoftware instructions relating to location services, such as GPSlocations. For example, client devices 150 may be configured todetermine a geographic location and provide location data and time stampdata corresponding to the location data.

Master server 160 may include one or more computing systems, such asservers, that are configured to execute stored software instructions toperform operations associated with providing a website to client devices150, including one or more processes associated with displayingwebsites, accepting login credentials, receiving requests (e.g., arequest for additional websites), information from cookies that arestore in client devices 150, etc.

In some embodiments, as shown in FIG. 1, the master server 160 can onlybe accessed through a supervisor subsystem. However, in otherembodiments local subsystem 110 and mobile subsystem 120 may directlyaccess the master server 160. In such embodiments, master server 160 maybe configured to request an access key from local subsystem 110 ormobile subsystem 120 before changes are implemented.

In some embodiments, local subsystem 110 and mobile subsystem 120 may beconnected to databases 180. In such embodiments, databases 180 mayinclude a communication device that sends information to local subsystem110, mobile subsystem 120, and supervisor subsystem 130. In someembodiments, anytime database 180 sends information to the localsubsystem 110 or the mobile subsystem 120, a copy of the exchange may besubmitted to supervisor subsystem 130. In such embodiments, supervisorsubsystem 130 may have a fraud or risk detection module that capturesabnormal behavior. For example, if the fraud or risk detection moduledetect that a the local subsystem 110 is requesting an abnormal amountof information from database 180, supervisor system 130 may stop oroverrule requests from the local subsystem to prevent systemmalfunctioning. In this way, supervisor subsystem 130 may identifydistributed attacks that target to affect the appropriate functioning ofsystem 100.

Databases 180 may include one or more computing devices configured withappropriate software to perform operations consistent with providinglocal subsystem 110, mobile subsystem 120, and supervisor subsystem 130with data required for page tag analysis. Databases 180 may include, forexample, Oracle™ databases, Sybase™ databases, or other relationaldatabases or non-relational databases, such as Hadoop™ sequence files,HBase™, or Cassandra™ Databases 180 may include computing components(e.g., database management system, database server, etc.) configured toreceive and process requests for data stored in memory devices of thedatabases and to provide data from the databases.

Network 170 may be any type of network configured to providecommunications between components of system 100. For example, network170 may be any type of network (including infrastructure) that providescommunications, exchanges information, and/or facilitates the exchangeof information, such as the Internet, a Local Area Network, a near fieldcommunication (NFC) device, an optical code scanner, or other suitableconnections or components that enable the sending and receiving ofinformation between the components of system 100. In other embodiments,one or more components of system 100 may communicate directly through adedicated communication link(s).

Network analyzer 190 may be a software or hardware device or system usedto measure parameters and data packages of a network. For example, insome embodiments network analyzer 190 may include a packet analyzerwhich may capture the structure or encapsulation of different networkingprotocols. In such embodiments, network analyzer 190 may parse anddisplay the fields along with their meanings as specified by differentnetworking protocols. For example, network analyzer 190 may beconfigured to capture and segment TCP/IP packets.

Network analyzer 190 may be configured to capture informationtransmitted from network 170 to client devices 150, to local subsystem110, or to mobile subsystem 120. In such embodiments, network analyzer190 may be configured to capture page tags associated with a website.For example, when browser application programming interface (API) 240 inlocal subsystem 110 accesses a website, network analyzer 190 may capturethe packets sent from the browser API 240 to the network 170. Networkanalyzer 190 may also specifically detect or identify packets that arerelated to page tags by, for example, filtering the captured packetsusing parameters such as header or value. Network analyzer may alsocapture the response of the network 170 directed to local subsystem 110.For example, network analyzer 190 may capture packets going from anonline resource 140 through network 170 to respond to local subsystem110. Network analyzer may also filter the captured packets to identifypage tags.

Network analyzer 190 may be configured to capture tags based on keywordsassociated with the page tag. For example, network analyzer may searchfor page tags associated with: Page Title; Meta Description; AuthorshipMarkup; OpenGraph tags; and Twitter Cards, among others.

While FIG. 1 shows network analyzer being a different element from localsubsystem 110, in some embodiments network analyzer 190 may beimplemented in processors of local subsystem 110. For example, networkanalyzer 190 may be implemented by local processor 230 (FIG. 2).However, in other embodiments, network analyzer 190 may be implementedin with specialized hardware. For example, network analyzer 190 may bean instrument with two ports, an input and an output, that is connectedbetween elements of system 100. As shown in FIG. 1 network analyzer maybridge network 170 with local subsystem 110 and mobile subsystem 120.Having specialized hardware to analyze the network packages may haveadvantages, particularly given the large amount of data that isexchanged between network 170 and subsystems 110 and 120. For example,if the amount of data between elements is very large, specializedhardware that stores and sorts the captured packages may improve thecomputer functioning by discretizing functions with embedded systems.

It is to be understood that the configuration and boundaries of thefunctional building blocks of system 100 have been defined herein forthe convenience of the description. Alternative boundaries can bedefined so long as the specified functions and relationships thereof areappropriately performed. Alternatives (including equivalents,extensions, variations, deviations, etc., of those described herein)will be apparent to persons skilled in the relevant art(s) based on theteachings contained herein. Such alternatives fall within the scope andspirit of the disclosed embodiments.

FIG. 2 is a block diagram of an exemplary local subsystem 110,consistent with disclosed embodiments. Local subsystem 110 may include acommunication device 210, a local memory 220, a browser API 240, and oneor more local processors 230. Local memory 220 may include an analyticsprograms 222, an analytics data 224, and a local benchmark record 226.Local processor 230 may include a development environment 232, ananalysis tool 234, a scenario compiler 236, and a report generator 238.

In some embodiments, local subsystem 110 may take the form of a server,general purpose computer, mainframe computer, or any combination ofthese components. However, in other embodiments, local subsystem 110 mayinclude multiple discrete hardware components connected in a localnetwork. For example, analysis tool 234 may be an field-programmablegate array (FPGA) specifically configured to analyze page tags, whilelocal processors 230 may be a multiple-core CPU. In addition, otherimplementations consistent with disclosed embodiments are possible aswell.

Communication device 210 may be configured to communicate with one ormore databases, such as databases 180 described above. In particular,communication device 210 may be configured to receive associated pagetags from database 180. In addition, communication device 210 may beconfigured to communicate with other components as well, including, forexample, supervisor subsystem 130, master server 160, and/or mobilesubsystem 120.

Communication device 210 may include, for example, one or more digitaland/or analog devices that allow communication device 210 to communicatewith and/or detect other components, such as a network controller and/orwireless adaptor for communicating over the Internet. Otherimplementations consistent with disclosed embodiments are possible aswell.

Local memory 220 may include one or more storage devices configured tostore instructions used by local processor 230 to perform functionsrelated to disclosed embodiments. For example, local memory 220 maystore software instruction modules, such as analytics program 222, thatmay perform one or more operations when executed by local processor 230.The disclosed embodiments are not limited to separate programs orcomputers configured to perform dedicated tasks. For example, localmemory 220 may include a single analytics program 222 that performs thefunctions of Local subsystem 110, or analytics program 222 may comprisemultiple programs. Local memory 220 may also store analytics data 224that is used by analytics program(s) 222.

In certain embodiments, local memory 220 may store sets of instructionsfor carrying out processes to analyze page tags, generate a page tagreport, and/or compare bench mark records with a test results, asdescribed below in connection with FIGS. 6-8. In certain embodiments,local memory 220 may store sets of instructions for publishing graphicalresults, such as the ones described below in connection with FIGS. 13and 14. Other instructions are possible as well. In general,instructions may be executed by local processor 230 to perform one ormore processes consistent with disclosed embodiments.

In some embodiments, local memory 220 may include a local benchmarkrecord 226. The local benchmark record may include page tags that areexpected to be present in a given scenario for a given website. Forexample, local benchmark record 226 may include a plurality of page tagsthat are associated with accessing a websites. Each local benchmarkrecord may include benchmark elements, which may represent each of thepage tags that are expected to be collected when accessing a websites.Thus, in such embodiments, a local benchmark record has a collection ofpage tags that are expected in the website. Benchmark elements may bestored by a user in local benchmark record by collecting the tags of aworking version of the website. For example, when a user determines thata website is working properly, it may collect the page tags associatedwith the website version and store them as the benchmark. Followingiterations on the website may use the benchmark tag record to evaluatethe effect on page tags by comparing the page tags recorded in a workingversion with the page tags collected in the modified version.

In some embodiments, local processor 230 may include one or more knownprocessing devices, such as, but not limited to, microprocessors fromthe Pentium™ or Xeon™ family manufactured by Intel™, the Turion™ familymanufactured by AMD™, or any of various processors from othermanufacturers. However, in other embodiments, local processor 230 may bea plurality of devices coupled and configured to perform functionsconsistent with this disclosure.

Local processor 230 may include a development environment 232, ananalysis tool 234, a scenario compiler 236, and a report generator 238.In some embodiments, local processor 230 may execute software to performfunctions associated with each component of local processor 230. Inother embodiments, each component of local processor 230 may be anindependent device. In such embodiments, each component may be hardwareconfigured to specifically process data or perform operations associatedwith page tag analysis, generating reports and/or handling testscenarios. For example, analysis tool 234 may be also include a Graphicsprocessing unit (GPU), and scenario compiler 236 may be a centralprocessing unit (CPU). Other hardware combinations are also possible. Inyet other embodiments, combinations of hardware and software may be usedto implement local processor 230.

Development environment 232 may run software for an acceptance testwritten in behavior-driven development (BDD) style. Developmentenvironment 232 may additionally include a plain language parser toallow certain scenarios to be specified in a local language that is easyto understand. For example, in some embodiments development environment232 may run a software tool configured to test other software, such asCucumber®, Capybara®, or Mocha™. In such embodiments, developmentenvironment 232 may be support a variety of programming languagesthrough various implementations that facilitate BDD testing by runningautomated acceptance tests written in a BDD style. Further, developmentenvironment 232 may utilize a non-technical and human readable parserthat describes use cases relating to a software system, such as aGherkin®. In such embodiments, development environment 232 may include aplain language parser that delineate a script for automated testing.

In some embodiments, to setup a test, a user in development environment232 may create a data format used for asynchronous browser/servercommunication. For instance, a user may create a Javascript ObjectNotation using, for example, newFileWriter(System.getProperty(“user.dir”)+“\\resources\\output1.json.”In such embodiments, human-readable text may be inputted in thedevelopment environment 232 to transmit data objects consisting of valueParis and array data types. For example, instructions may be transmittedwith commands that include “keywords” such as “GIVEN” and “THEN” todescribe an scenario. In some embodiments, the instructions in thedevelopment environment 232 may include:

-   -   Scenario: Validate web-analytics for website    -   Given|access the website    -   Then|validate site catalyst tag for website is working as        expected    -   |TageName|Tag Value|

In some embodiments, development environment 232 may replace encodeddata of the BDD style test using a string conversion. For example, insome embodiments, development environment 232 may execute acharacter-per-character conversion of UTF-8 encoded data. The conversionmay result in a refined BDD style. Development environment 232 may thencompare the human-readable instructions with the encoded data. When thehuman-readable instructions match the encoded data, developmentenvironment 232 may compile a testing scenario which is communicated tobrowser API 240. Browser API 240 may then execute the scenario andcollect and store tags for each one of the scenarios.

In some embodiments, local processor 230 may implement developmentenvironment 232 by executing instructions to create a virtualenvironment in which the scenarios are inputted and compiled. In otherembodiments, however, development environment 232 may be a separatedevice or group of devices. In such embodiments, development environment232 may include hardware configured to effectively carry out paralleltasks to cover the greatest number of scenarios. For example, to improveperformance and minimize costs, development environment 232 may be anSRAM-based FPGA that functions as development environment 232.Development environment 232 may have an architecture designed forimplementation of specific algorithms. For example, developmentenvironment 232 may include a Simple Risc Computer (SRC) architecture orother reconfigurable computing system.

Local processor 230 may implement analysis tool 234 by executingsoftware to create an environment for comparing collected and benchmarkpage tags. However, in other embodiments analysis tool 234 may includeindependent hardware with specific architectures to improve theefficiency of comparison and sorting processes. For example, analysistool 234 may be a GPU array configured to sort collected page tags andcompare them with the benchmark tags. In some embodiments, analysis tool234 may be configured to implement sorting algorithms such as, forexample, radix sort. Alternatively or additionally, analysis tool 234may be configured to implement a programming interface, such as ApacheSpark, and execute data structures, cluster managers, and/or distributedstorage systems. For example, analysis tool 234 may include a resilientdistributed dataset that is manipulated with a standalone softwaresubsystem and/or a distributed file system.

Scenario compiler 236 may receive a scenario from developmentenvironment 232 to encode data for execution in browser API 240. Forexample, scenario compiler 236 receive testing scenarios and thencompile them in parallel or sequence. Scenario compiler 236 may thenarrange the testing scenarios based on similarity to organize them andmake the process more efficient. For example, the scenario compiler 236may determine the complexity of the scenarios and start with lesscomplex scenarios and progressively compile more complex scenarios. Inaddition, scenario compiler 236 may detect similarities betweenscenarios and recycle the compiled instructions. For example, whenmultiple scenarios have the instruction “Given|access the website,”scenario compiler 236 may improve the functioning of the computer bystoring machine-readable instructions associated with such instructionsto minimize the compiling time.

Scenario compiler 236 may be implemented by local processor 230. Forexample, local processor 230 may execute software to create anenvironment to execute models. However, in other embodiments scenariocompiler 236 may include hardware configured to carry out paralleloperations. Some hardware configurations improve the efficiency ofcalculations, particularly when multiple compilations are beingprocessed in parallel. For example, scenario compiler 236 may includemulticore processors or computer clusters to divide tasks and quicklycompile testing scenarios. In some embodiments, developer environment232 may be configured to generate series of testing scenarios withpermutations of steps or different page tag values. In such embodiments,scenario compiler 236 may include a scheduling module. The schedulingmodule may receive testing scenarios, as specified by developmentenvironment 232 and assign an order of execution. In other embodiments,scenario compiler 236 may be implemented as FPGA arrays to providegreater performance and determinism.

Local processor 230 may additionally include report generator 238.Report generator may be implemented when local processor 230 executesinstructions stored analytics program 222. However, in otherembodiments, report generator 238 may be hardware specifically design togenerate reports. As previously discussed, hundreds or even thousands ofpage tags may be associated with a website. Thus, it may be inefficientto merely report the status of each tag. Instead, report generator 238may analyze results from analysis tool 234 and encode information tofacilitate its exchange between subsystems in system 100. In someembodiments, report generator 238 may break results from analysis tool234 into groups of page tags having a fixed number of bits. Then, reportgenerator 238 may compute the exclusive or (XOR) of all those page tagsto create a score. The score may then be reported to other subsystems asthe results from a test run analyzed by analysis tool 234. Reportgenerator 238 may also be configured to generate graphical data or athreshold score for the comparison of scores between the expected andcollected data. In some embodiments, report generator 238 may classifypage tags in level of criticality. For example, when a page tagassociated with a login is critical, mismatches or errors in such pagetag may be identified and presented in a “Failing” report. However,other page tags, such as loading time, may not be critical and onlypartially affect the report score. In yet other embodiments, reportgenerator 238 may generate graphical reports.

The components of local subsystem 110 may be implemented in hardware,software, or a combination of both, as will be apparent to those skilledin the art. For example, although one or more components of localsubsystem 110 may be implemented as computer processing instructionsembodied in computer software, all or a portion of the functionality oflocal subsystem 110 may be implemented in dedicated hardware. Forinstance, groups of GPUs and/or FPGAs maybe used to quickly analyze datain local processor 230.

FIG. 3 is a block diagram of an exemplary model generator, consistentwith disclosed embodiments. Supervisor subsystem 130 may include animplementation control 320, a supervisor browser API 330, a reportanalyzer 340, a supervisor processor 350, and a communication device310.

The complexity of web projects demands strict control on changes and newfeatures that will be implemented. Particularly in collaborativeenvironments, in which different groups work in parallel developingfeatures, it becomes important to establish systems that controlchanges. Supervisor subsystem 130 of system 100 facilitates verifyingand implementing new features and changes by creating an interfacebetween developers and master server 160.

Similar to communication device 210, communication device 310 insupervisor subsystem 130 may be configured to communicate with databases180, local subsystems 110, mobile subsystems 120, and master server 160.Communication device 310 may include, for example, one or more digitaland/or analog devices that implement communication device 310 and othercomponents, such as a network controller and/or wireless adaptor forcommunicating over the Internet. Other implementations consistent withdisclosed embodiments are possible as well.

Supervisor subsystem 130 may include an implementation control 320.Implementation control 320 may include a processor and a memory thatmanages and configure a supervisor analysis program 322, a key generator324, and a supervisor benchmark record 326.

Supervisor analysis program 322 may include instructions to perform webanalytics testing on a website. For example, supervisor analysis program322 may include a non-transitory memory device that stores a set ofstandardized testing scenarios. The standardized testing scenarios mayinclude a set of scenarios that guarantee basic functioning of thewebsite. For example, the standardized testing scenarios may includetesting of basic website accessibility or accurate functioning ofencryption processes.

Key generator 324 in supervisor subsystem 130 may be a module thatgenerates a key, such as a serial number, that would be necessary toimplement changes in master server 160. In some embodiments, keygenerator 324 may store a plurality of public key infrastructure (PKI)certificates that may be distributed to, for example, local subsystem110 and mobile subsystem 120.

Supervisor benchmark record 326 in supervisor subsystem 130 may store aplurality of global benchmark tags. While local benchmark tags stored indatabase 180 or local benchmark record 226 may include informationrelated to specific features in a website, global benchmark tags mayrecord elements that are expected for interactions between differentwebsites of the project. For example, supervisor benchmark record 326may include benchmark page tags that relate links between websites,exchanges of information, and/or the number of events that is fired inthe plurality of websites. The supervisor benchmark record is configuredto coordinate and verify the events of multiple interactions.

Supervisor subsystem 130 may also include a supervisor processor 350which may include a master development environment 352, a managementtool 354, a supervisor compiler 356, and a master analysis tool 358.

Master development environment 352 may be similar to developmentenvironment 232, but be configured to develop setup scenarios that testmultiple websites.

Supervisor compiler may similarly compile information test scenarios andsend them to supervisor browser API 330 for execution. The resultingpage tags may then be compared against page tags recorded in thesupervisor benchmark record 326. Results may be analyzed by masteranalysis tool 358 that then may accept or reject new features andchanges from the local subsystem 110.

In some embodiments, supervisor subsystem 130 may analyze a report fromlocal subsystem 110 using a report analyzer. In such embodiments,supervisor subsystem 130 may accept or discard changes based only on thereport results. For example, if the report result indicates there are nofaulty page tags, supervisor subsystem 130 may immediately implementchanges. In other embodiments, however, supervisor subsystem 130 may runa new test before applying changes. For instance, supervisor subsystem130 may use master analysis tool 358 perform an additional analysisbefore implementing the website changes.

When the supervisor subsystem 130 determines that the changes or newfeatures may be implemented, whether based on the master analysis toolresults or the report analyzer, it may instruct key generator 324 togenerate a key for local subsystem 110 that would enable local subsystem110 to execute the changes. However, in alternative embodiments,supervisor subsystem 130 may override key generation steps and directlyimplement changes, communicating with the master server 160.

In some embodiments, supervisor processor 350 may also include amanagement tool 354 that tracks and records events and changes in thesupervisor subsystem 130. For example, management tool 354 may recordthe number of changes performed or store interactions between databases180, local subsystem 110 and mobile subsystem 120.

FIG. 4 is a block diagram of an exemplary database 180, consistent withdisclosed embodiments. Database 180 may include a communication device402, one or more database processors 404, and a database memory 410including one or more database programs 412 and data 414.

In some embodiments, databases 180 may take the form of servers, generalpurpose computers, mainframe computers, or any combination of thesecomponents. Other implementations consistent with disclosed embodimentsare possible as well.

Communication device 402 may be configured to communicate with one ormore components of system 100, local subsystem 110, mobile subsystem120, and/or supervisor subsystem 130. In particular, communicationdevice 402 may be configured to provide to local subsystem 110 andmobile subsystem 120 data associated with page tags or associatedmetadata.

Communication device 402 may be configured to communicate with othercomponents as well, including, for example, supervisor subsystem 130 andmaster server 160, and one or more online resources 140. Communicationdevice 402 may take any of the forms described above for communicationdevice 210.

Database processors 404, database memory 410, database programs 412, anddata 414 may take any of the forms described above for local processors230 and local memory 220, respectively. The components of databases 180may be implemented in hardware, software, or a combination of bothhardware and software, as will be apparent to those skilled in the art.For example, although one or more components of databases 180 may beimplemented as computer processing instruction modules, all or a portionof the functionality of databases 180 may be implemented instead indedicated electronics hardware.

Data 414 may be data associated with specific websites. For example,data 414 may include groups of benchmark page tags and includeinformation associated with a plurality of websites. Data 414 mayinclude, for example, a feature vector for each website. The featurevector may include a website ID, a plurality of benchmark page tags forthe website, and a weighting associated with each benchmark. Data 414may describe functions or expected behavior of the website. For example,data 414 may indicate expected loading time of the website.

FIG. 5 is a block diagram of an exemplary master server 160, consistentwith disclosed embodiments. In some embodiments, master server 160 maysupport or provide a cloud computing service, such as Microsoft Azure™or Amazon Web Services™. In such embodiments, master server 160 mayinclude one or more distributed computer systems capable of performingdistributed computing functions and providing cloud computing servicesand functions consistent with disclosed embodiments. In someembodiments, master server 160 may operate in conjunction withsupervisor subsystem 130. In other embodiments, master server 160 mayoperate alone. In such embodiments, master server 160 may perform allfunctions associated with the disclosed methods.

As shown in FIG. 5, master server 160 may include one or moreprocessor(s) 520, input/output (“I/O”) devices 530, a memory 540 storingprograms 542 (including, for example, server app(s) 544 and operatingsystem 546) and data 548 (including website status data 549), and aserver database 570. Master server 160 may be a single server or may beconfigured as a distributed computer system including multiple serversor computers that interoperate to perform one or more of the processesand functionalities associated with the disclosed embodiments.

Processor(s) 520 may be one or more known computing devices, such asthose described with respect to processor 230 in FIG. 2.

In some embodiments, master server 160 may also include one or more I/Odevices 530 including interfaces for receiving signals or input fromdevices and for providing signals or output to one or more devices thatallow data to be received and/or transmitted by master server 160. Forexample, master server 160 may include interface components, which mayprovide interfaces to one or more input devices, such as one or morekeyboards, mouse devices, and the like, that enable master server 160 toreceive input from users associated with system 100.

In some embodiments, master server 160 may include one or more storagedevices configured to store information used by processor 520 (or othercomponents) to perform certain functions related to the disclosedembodiments. In one example, master server 160 may include memory 540that includes instructions to enable processor 520 to execute one ormore applications, such as server applications, an electronictransaction application, an account status application, networkcommunication processes, and any other type of application or softwareknown to be available on computer systems. Alternatively oradditionally, the instructions, application programs, etc. may be storedin an internal database 570 or databases 180 (shown in FIG. 1) incommunication with master server 160, such as one or more database ormemory accessible over network 170. Database 570 or other externalstorage may be a volatile or non-volatile, magnetic, semiconductor,tape, optical, removable, non-removable, or other type of storage deviceor tangible (i.e., non-transitory) computer-readable medium.

In one embodiment, master server 160 may include memory 540 whichincludes instructions that, when executed by processor 520, perform oneor more processes consistent with the functionalities disclosed herein.Methods, systems, and articles of manufacture consistent with disclosedembodiments are not limited to separate programs or computers configuredto perform dedicated tasks. For example, master server 160 may includememory 540 that may include one or more programs 542 to perform one ormore functions of the disclosed embodiments. Moreover, processor 520 mayexecute one or more programs that may be displayed in client devices150.

Programs 542 stored in memory 540 and executed by processor(s) 520 mayinclude one or more server app(s) 552 and an operating system 546.Server app(s) 552 may incorporate one or more apps configured to receiveand process requests from online resources 140 or client devices 150.

In some embodiments, memory 540 may store data 548 including websitestatus data associated with websites, client information, orauthentication information. For example, data 548 may associate usersidentifications with passwords. Data 548 may also include informationabout page tags store in client devices 150. For the purpose of thisapplication, procedures is not limited to a medical procedure and mayinclude multiple tasks that may be performed by an online provider.

In some embodiments, memory 540 and database 570 may include one or morememory devices that store data and instructions used to perform one ormore features of the disclosed embodiments. Memory 540 and database 570may also include any combination of one or more databases controlled bymemory controller devices (e.g., server(s), etc.) or software, such asdocument management systems, Microsoft SQL databases, SharePointdatabases, Oracle™ databases, Sybase™ databases, or other relationaldatabases.

Master server 160 may communicate with one or more remote memory devices(e.g., databases 180). The remote memory devices may be configured tostore information and may be accessed and/or managed by master server160. By way of example only, the remote memory devices may be documentmanagement systems, Microsoft SQL database, SharePoint databases,Oracle™ databases, Sybase™ databases, or other relational databases.Systems and methods consistent with disclosed embodiments, however, arenot limited to separate databases or even to the use of a database.

FIG. 6 is a block diagram of an exemplary client device 150, consistentwith disclosed embodiments. In one embodiment, client devices 150 mayinclude one or more processors 602, one or more input/output (I/O)devices 604, and one or more memories 610. In some embodiments, clientdevices 150 may take the form of mobile computing devices such assmartphones or tablets, general purpose computers, or any combination ofthese components. Alternatively, client devices 150 (or systemsincluding client devices 150) may be configured as a particularapparatus, embedded system, dedicated circuit, and the like based on thestorage, execution, and/or implementation of the software instructionsthat perform one or more operations consistent with the disclosedembodiments. According to some embodiments, client devices 150 maycomprise web browsers or similar computing devices that access websiteconsistent with disclosed embodiments.

Processor 602 may include one or more known processing devices, such asmobile device microprocessors manufactured by Intel™, NVIDIA™, orvarious processors from other manufacturers. The disclosed embodimentsare not limited to any specific type of processor configured in clientdevices 150.

Memory 610 may include one or more storage devices configured to storeinstructions used by processor 602 to perform functions related todisclosed embodiments. For example, memory 610 may be configured withone or more software instructions, such as programs 612 that may performone or more operations when executed by processor 602. The disclosedembodiments are not limited to separate programs or computers configuredto perform dedicated tasks. For example, memory 610 may include a singleprogram 612 that performs the functions of the client devices 150, orprogram 612 may comprise multiple programs. Memory 510 may also storedata 314 that is used by one or more programs 612.

In certain embodiments, memory 610 may store a log page tags of websitesclient devices 150 has visited. In some embodiments master server 160may request logs of faulty tags to include them in, for example,supervisor benchmark record 326 or local benchmark record 226. In otherembodiments, memory 610 may include cookies with faulty tags 614. Forexample, memory 610 in client device 150 may include a record ofpersistent cookies that store warning messages. In such embodiments, thecookies may include an expiration date. In such embodiments, clientdevice 150 may transmit the faulty cookies to master server 160, whichmay include the faulty cookie information and make adjustments thesupervisor benchmark record 326 record or the local benchmark record226.

I/O devices 604 may include one or more devices configured to allow datato be received and/or transmitted by client devices 150 and to allowclient devices 150 to communicate with other machines and devices, suchas other components of system 100.

The components of client devices 150 may be implemented in hardware,software, or a combination of both hardware and software, as will beapparent to those skilled in the art.

FIG. 7 is an exemplary flow chart illustrating a page tag analysisprocess, consistent with disclosed embodiments. In some embodiments,process 700 may be executed by local subsystem 110 (FIGS. 1 and 2).

Process 700 may be executed when a scenario is compiled at, for example,scenario compiler 236 (FIG. 2). In step 702, local subsystem 110 mayaccess a landing page by, for example, using browser API 240. Localsubsystem 110 may additionally execute a series of instructionsaccording a command sequence. In some embodiments, the command sequencemay be based on the commands previously disclosed.

In step 704, local subsystem 110 may collect tags associated with thelanding page and each one of the testing scenarios. In certainembodiments, local subsystem 110 may be configured to collect a majorityof the page tags. However, in other embodiments local subsystem 110 maybe configured to collect a group of specific page tags. In yet otherembodiments, local subsystem 110 may collect all page tags.

In step 706, local subsystem 110 may execute a command as specified bythe command sequence. In certain embodiments the command sequence may bebased on a Gherkin. The command may include web actions. For example,the command may include accessing a link or introducing credentials.

In step 708 local subsystem 110 may collect a second set of page tagsthat are associated with the landing page after the web action has beenexecuted. For example, local subsystem 110 may collect a new set of tagsin a different memory space.

In step 710, local subsystem 110 may determine whether the testingscenario has any actions remaining. When the testing scenario has notbeen completed and additional web actions are remaining in the testscenario, local subsystem 110 may return to step 706 and execute asubsequent web action (step 706) and collect web action page tags (step708). However, if in step 710 local subsystem determines that noremaining actions are available, local subsystem may continue to step712.

In step 712 local subsystem 110 may generate a result tag record. Insome embodiments, the result tag record may compile all the collectedtags in a single file with a predetermined format. For example, localsubsystem may aggregate the tags collected in step 708, and thediscussed iterations, to create a result tag record. The result tagrecord may list all page tags with their associated values.

In step 714, local subsystem 110 may modify the result tag record togenerate a normalized tag record. The normalized tag record may modifyvalues associated with the result tag record so they are compatible withdata 414 in database 180 or the page tags stored in local benchmarkrecord 226 and supervisor benchmark record 326. For example, if therecord tag associated with a loading time is described in millisecondsbut the a benchmark tag associated with the loading time is described inseconds, at step 714 local subsystem 110 may generate a normalized tagrecord by converting the loading time from milliseconds to seconds.Similarly, if the result tag has values that need other transformations,local subsystem 110 may transform the values by generating thenormalized tag records.

Generating a normalized tag record may include creating page tag classesthat are then used to categorize page tags. This division of tasks mayimprove the computer efficiency by analyzing similar tags. Page tags mayhave different types. For example, page tags may relate to images ortext. Separating page tags under these categories facilitate laterprocessing by allowing use of specialized software or hardware tailoredfor each kind of page tag type. For instance, an image processing FPGAmay be used to process page tag related to images, while standardprocessors may be used to analyze page tags associated with text.Therefore, generating a normalized tag record may include determining aplurality of page tag classes according to parameters associated withthe page tags; and generating a normalized tag record, in which thenormalized tag record comprises normalized elements, normalized elementsare modified to tailor with collected elements, and normalized elementsare associated with page tag classes values.

Categorization enables the division of tasks to improve the efficiencyof the process. For example, generating a numeric search record on acategorized portion of a page tag record may be more efficient thanperforming the same task with a full set of page tags. By partitioningthe data in classes, the conversion processes will be similar and resultin a more streamlined and less expensive process. Therefore, once thedata is categorized, to generate the normalized tag record, localsubsystem 110 or subsystem in system 100 may generate a numeric searchrecord based on the collected tag record, where the numeric searchrecord comprises search elements. The search elements may berepresentations of the collected tags but formatted in a way thatsimplify searches. For example, search elements may include a pointer tothe collected tag but be only a numeric value that can be sorted. Insome embodiments, local subsystem 110 may also sort the search elements,further dividing the search elements into search subgroups, the searchsubgroups having the same number of search elements; and distributingthe search subgroups to a plurality of dedicated processors. Thiscascading division of page tags into several groups with commonalitiessignificantly improves computer efficiency by improving searching andsorting algorithms and leveraging parallel computing techniques. Forexample, the use of GPUs for quick operations may be used to efficientlygenerate the normalized tag records.

In step 716, local subsystem 110 may retrieve a benchmark tag record.For example, local subsystem 110 may query database 180 and request alist of benchmark tag records. In some embodiments, an identification ofthe benchmark tag records may match the normalized tag records. However,in other embodiments benchmark tag records may be independent from thenormalized tag record.

In step 718, local subsystem 110 may filter the normalized tag recordbased on the benchmark tag record. For example, local subsystem maycompare the normalized tag record and the benchmark tag record andfilter the normalized tag record by eliminating page tags that are notin the benchmark tag record. In other embodiments, the filtering processmay be based on intrinsic characteristics of the tags. For example, auser may select to filter all tags that have no change.

To improve the efficiency of the filtering process, instruments that areparticularly programmed to filter elements may be employed forprocessing the page tags. For example, a field-programmable gate array(FPGA) may be configured to receive the collected tag record and thebenchmark tag record; and return a filtered tag record having onlymatching elements that appear in both the collected tag record and thebenchmark tag record.

In step 720, local subsystem 110 may analyze the normalized tag recordbased on the benchmark tag record. For example, local subsystem 110 maycompare values of tags having the same tag ID. The analysis of step 720may include labeling or flagging tag records that match or do not matchthe value of the benchmark tag. For example, local subsystem 110 maygenerate a table with tags of matching records and a second table withtags with non-matching tag records. In addition, in step 720 localsubsystem 110 may categorize tags based on priority. For example, localsubsystem may divide tags in high, medium, and lower priority.

In step 722, local subsystem 110 may generate a result. For example,local processor 230 may instruct report generator 238 to generate arecord based on the analysis. In certain embodiments the recordgenerator may generate a single reporting file with a binaryclassification of tags. In other embodiments record generator may outputan analysis score.

The result generated in step 722 may be used by supervisor subsystem 130to generate keys that allow the implementation of changes in masterserver 160. For example, local subsystem 110 may communicate a resulttag record, which includes the result of the analysis between normalizedtag record and benchmark tag records, and generate a test record for asupervisor subsystem 130. Local subsystem 110 may then request, fromsupervisor subsystem 130, an authorization to implement a websitefeature. Based on the results that are obtained, supervisor subsystem130 may then grant a key or sent an error message. For example,supervisor subsystem may interpret the test record and determine if itis acceptable to implement changes. That is, the results in the testrecord may provide information on whether the website feature that localsubsystem 110 is attempting to implement has a clear record based on theidentified page tags. When supervisor subsystem 130 determines that thetest record is acceptable, it may transmit, to master server 160 theimplementation of the new website feature. Alternatively, supervisorsubsystem 130 may send a key to local subsystem 110. The key may grantaccess to master server 160 to implement the changes. The use of a keyto grant access guarantees that supervisor subsystem 130 has controlover the changes applied to the master server, but at the same timeprovides flexibility to enable other subsystems to perform the changesto prevent overloading of supervisor subsystem 130.

In some embodiments, supervisor subsystem 130 may be configured togenerate a second result tag record, the second result tag recordindicating matches and mismatches between the benchmark tag record andthe collected tag record. This operation may facilitate the decision ofsupervisor subsystem to grant or deny a key for changes creating asimpler evaluation. For example, the second result tag record may simplyrecord a Boolean variable for matches an mismatches and grant accesswhen adding the Boolean variables overcomes a predefined threshold.

Further, in embodiments in which supervisor system 130 may generate keysto enable implementation of changes, the key may be generated to modifyspecific portions of the website. For example, source code of thewebsite may be compartmentalized in multiple functions. Thus, localsubsystem 110 may further configured to request, from supervisorsubsystem 130, a feature key specific for the targeted function. Forexample, if the website feature that will be implemented changes thepassword feature, local subsystem 110 may request a feature key for thepassword function. Supervisor subsystem 130 may be configured togenerate the feature key. In some embodiments, the feature key may onlybe generated when report analyzer 340 determines that the result tagrecord passed a management test. The management test may include nochanges in previous tags, or no changes in critical tags that werepreviously recorded.

FIG. 8 is an exemplary flow chart illustrating a page tag normalizationprocess, consistent with disclosed embodiments. Result tag generationprocess 800 may be carried out by local subsystem 110. In someembodiments the steps described in process 800 may also be implementedduring process 700, for example, at step 712.

In step 802, local subsystem 110 may receive a collection of tags andreceive instruction to start aggregating page tags to generate a resultspage tag.

In step 804, local subsystem may detect outlier or incomplete page tags.For example, local subsystem 110 may execute an outlier detectionprocess with values outside an expected range to delete them from theaggregated list. In such embodiments, the deleted tags with outliervalues may be recorded in a failed list.

In steps 806 and 808, local subsystem 110 may process the collected tagsby saving outliers in temporary report records or eliminate outliers orincomplete results from the results record.

In step 810, local subsystem 110 may determine a number of classes foreach entry. For example, local subsystem 110 may divide the total numberof tags in a group of classes. In other embodiments local subsystem 110may determine classes based on a tag category. For example, localsubsystem may determine tags based on binary, integer, character,associated values. In other embodiments, however, the classes may bedetermined based on a priority of tags.

In step 812, local subsystem 110 may associate a rule with each class.For example, local subsystem 110 may associate integer page tags with aminimum value and determine a result based on the page tag value for acategory that is related to an integer value.

In step 814, local subsystem 110 may determine a number of elements forthe name tags and associate the number to a temporary variable.

In step 816, local subsystem 110 may determine a value for each one ofthe records for in the results record. For example, local subsystem 110may associate a binary value with the record, depending on the numberrule and the value associated with the tag.

In steps 818 and 820, local subsystem 110 may generate two records basedon the determinations of step 816. In step 818, local subsystem 110 maystore fault values in a temporary record. In step 820, local subsystem110 may store fault values in a temporary record.

In step 822, local subsystem may modify the a temporary value tocontinue the iterations.

In step 824, local subsystem 110 may determine whether additionalelements are present in the collected tags. When local subsystem 110determines that the elements in the collected tag record have not beenfinalized (step 824: no), local subsystem 110 may return to step 816 tocontinue determinations for each class and storing in normalized tagrecords or in a temporary report. However, if local subsystem 110determines that the elements in the collected tag record have beenfinalized (step 824: yes), local subsystem 110 may communicatenormalized tag record and temperature report record at step 826.

FIG. 9 is an exemplary flow chart illustrating a page tag searchingprocess, consistent with disclosed embodiments. In some embodiments,local subsystem 110 may carry out searching process 900.

In step 902, local subsystem 110 may generate a search record. In someembodiments, local subsystem 110 may generate a search record by copyinga complete in a new vector. For example, local subsystem 110 may copy aresults record, a collected record, or a normalized record. In otherembodiments, local subsystem 110 may generate the search record based ona primary record, but without copying the full record. For example,local subsystem 110 may generate a sorting record with only tagidentifiers, without values, or with only values, and not tagidentifiers.

In step 904, local subsystem 110 may generate a numeric search record.The numeric search record may be generated by modifying the record tagrecord. For example, the numeric record may be created by convertingcharacter variables, such as an identifier, to a number. Given the largeamount of records too be sorted, the conversion process may be done withalgorithms that improve the computer functionality by reducing thenumber of cycles required to perform the conversion. For example,algorithms such as char2num may be performed by local processor tomodify the search record into a numeric search record. This practiceimproves the computer functioning by reducing the amount of memorydedicated to store the record and simplify comparative searches bycomparing numbers rather than characters. If a variable contains integerdata which will not necessarily be used in any calculations, it ispreferable to save it as a variable of type numeric rather than avariable of type character, even if there is no intention of performingalgebraic calculations using the variable. For example, a nominalvariable is preferable to store as a numeric variable with anappropriate format rather than a character variable. It is preferable touse numeric variables whenever possible, since this eliminates the needto consider leading and trailing blanks when making comparisons. Inaddition, a pointer variable may be associated to the search records tomaintain a relationship table between the numeric record and the searchrecord, which can be easily correlated with the numeric record.

In step 906, local subsystem 110 may sort the numeric search record.While the sorting process may be done using local processor 230configured with sorting software, to minimize waiting times it may bedone with hardware that is specially configured to sort records. Forexample, an FPGA may receive and have an arrangement to quicklycategorize the record.

In step 908, local subsystem 110 may divide the sorted numeric record inmultiple records with different ranges.

In step 910, local subsystem 110 may retrieve a selected element fromthe benchmark tag record that will be searched in the search record.

In step 912, local subsystem 110 may generate a numeric benchmarkelement by converting the identity of the benchmark element to a numericvalue. Similar processes and/or hardware that is used in step 904 togenerate the numeric search record may be used to generate the numericbenchmark element.

In step 914, local subsystem 110 may determine whether the middleelement of the sorted numeric record is equal to the numeric benchmarkelement. If the benchmark element is equal to the middle of the sortednumeric record (step 914: yes), local subsystem 110 may add benchmarkelement to a report. However, if the benchmark element is not equal tothe middle of the sorted numeric record (Step 914: no), local subsystem110 may continue to step 918 and determined whether the benchmarkelement is greater than the middle element.

When local subsystem 110 determines the benchmark element is greaterthan the middle element (step 918: yes), local subsystem 110 maycontinue to step 922 an eliminate the upper half of the numeric search.However, if local subsystem 110 determines the benchmark element is notgreater than the middle element (step 918: no), local subsystem 110 maycontinue to step 920 and eliminate the lower half of the numeric search.

In step 924, local subsystem 110 may determine whether the numericsearch record is empty. When local subsystem 110 determines the numericsearch record is not empty it may return to step 914 and evaluate themiddle element of the new search record, which has only half the numberof elements than the one that started in the previous step, and continuethe search for the benchmark element in the search record. However, iflocal subsystem 110 determines that the numeric search record is empty,(step 924: yes), local subsystem 110 may conclude that the benchmarkelement is not present in the search record and, in step 926, reportthat the benchmark element is not in the search record.

FIG. 10 is an exemplary character-based search process for determiningpresence of an element in a record. In some embodiments, thecharacter-based process search may be performed by local subsystem 110.The character-based process may be used to determine whether a page tagis present in a group of page tags improving the search speed. Forexample, by doing a character-by-character analysis, records can beeasily parsed and search routines can be efficiently programmed.

In step 1001, local subsystem 110 may read all characters in anormalized tag record. For example, if the normalized tag recordincludes the following three tags: (i) PAGE, (ii) TIME, and (iii)REPORT, local subsystem 110 may read all files and create the followingexemplary string “PAGETIMEREPORT.”

In step 1002, local subsystem 110 may create a node for each characterin the file, and, in step 1004, associate nodes based on a stringsequence. For example, with the exemplary string described in theprevious paragraph, local subsystem 110 may associate P and A with aweighting of one since they are consecutive in one instance. However, inthe same example, E and R may be associated with a weighting of 2 sincethere are two connections between an E and an R. Creating nodes andconnections based on a string, results in a character decision tree thatcan be used to compare whether an element shares the same characters tothe string in the order that is determined by the string.

In step 1006, local subsystem 110 may read characters in a benchmarkelement to analyze with the character decision tree. In some embodimentslocal subsystem 110 may generate a string for the benchmark. Forexample, if the benchmark includes numeric values that are not representwith characters, local subsystem 110 may truncate non-character valuesbefore comparing with the character decision tree.

In step 1008, local subsystem 110 may determine if there is a node witha character in the expected element. If there are no nodes with thefirst character of the benchmark element (step 1008: no), then localsubsystem 110 may report there is no matching element continuing to step1010, in which local subsystem 110 reports there are no matchingelements. However, if step 1008 determines that there is a node with thefirst character of the benchmark element (step 1008: yes), then localsubsystem 110 may continue to step 1012, eliminate the matching node(step 1012), and continue to step 1014.

In step 1014, local subsystem 110 determines whether there are at leasttwo elements in the benchmark element. If there are less than twoelements, local subsystem 110 may conclude that all elements in thebenchmark element have been matched with elements in the decision treeand that the benchmark element is empty, and continue to step 1016, inwhich local subsystem 110 may report the benchmark element is present inthe normalized tag record. However, when local subsystem 110 determinesthe benchmark element is not empty, it may eliminate the character thatwas matched with the decision tree (step 1020) and then return to step1006 to read a following character in the benchmark element at step1006.

The character search of a benchmark page tag in the normalized page tagrecord may improve the efficiency of the system and increase the speedof records.

FIG. 11 is an exemplary flow chart illustrating a page tag analysisprocess implemented with a modified web browser, consistent withdisclosed embodiments. Process 1100 may be implemented by localsubsystem 110. However, other components of system 100, such assupervisor subsystem 130 may also implement process 1100.

In step 1102, local subsystem 110 may receive a web address from amodified web address. In some embodiments, local subsystem 110implements and displays the modified web browser. However, in otherembodiments, the modified web browser may be implemented in a differentsubsystem, such as mobile subsystem 120.

The modified web browser may be a regular web browser, such as GoogleChrome™, Mozilla Firefox™, Microsoft Edge™, Opera™, Apple Safari™SeaMonkey™, Pale Moon™, etc., which is configured to implement tasksassociated with process 1100. For example, the modified web browser mayinclude an extension that facilitates collection and screening of pagetags. The extensions may include plugins that use Java Script ObjectNotation (JSON) format to define certain properties, embedded Javascriptfunctions, and HTML modules that display controls associated with theextension. The extension may implement the following functions: (i)function beforeRequest(req_details)—Get the data before web-analyticsevent is executed; (ii) functionbeforeSendHeaders(req_details)—Configure headers before sendingweb-analytics event; (iii) function headersReceived(req_details)—Headersreceived from web-analytics event; (iv) functioncompleted(req_details)—Finished capturing web-analytics event data; (v)function errorOccurred(req_details)—Error occurred in web-analyticsevent; (vi) function setIcon(active)—Set the icon to required icon.

Receiving the web address may include accessing the website associatedwith the web address via the modified web browser. In such embodiments,local subsystem 110 may determine whether the web address is a fullyqualified address. A fully qualified address may include several partssuch as a hostname, a domain name, and an extension (also known astop-level domain). For example, the fully qualified address may be“example.organization.com,” where the host name “example” is followed bythe domain “organization.com.” Local subsystem 110 may employ aplurality of processes and functions to determine whether the webaddress is fully qualified. For example, local subsystem 110 may applyan address test function.

When the address in not a fully qualified address local subsystem 110may convert the given address by dividing it in the three sections offirst subdomain, second subdomain, and top-level-domain, organized inthat order.

In step 1104, local subsystem 110 may capture page tags of the websiteassociated with the web address received from the modified we browser.In some embodiments, local subsystem 110 may use a capturing module tocapture the page tags. In some embodiments, the capturing module may beimplemented with network analyzer 190. For example, local subsystem 110may use network analyzer 190 to capture all packets exchanged vianetwork 170 and the use the extension of the modified web browser toidentify or select page tags. In other embodiments, capturing module maybe implemented within the modified web browser. For example, a metadatafile in JSON format containing properties like extension's name,description, and version number may be used to declare a web browserextension and provide permissions. Then, the metadata file may beconfigured to capture the page tags every time the web browsers accessesa website. In yet other embodiments, network analyzer 190 may bothcollect packets exchanged with network 170 and filter the packets toidentify page tags. In addition, in step 1104, local subsystem 110 mayalso create a vector with captured tags.

In step 1106, local subsystem 110 may generate a collected page tagrecord. The collected page tag record may associate the captured pagetags with property values. The property values may be one or morevariables that defined the page tag. For example, in some embodimentslocal subsystem 110 may configure a plurality of html headers, eachheader being associated with a page tag, parse the website using thehtml headers; and determine an error occurred when none of the htmlheaders is found in a source code of the website. Additional processesto generate a collected page tag may include developing an array ofcollected page tags in a cache memory.

In step 1108, local subsystem 110 may receive a probe tag from themodified web browser. Local subsystem 110 may use the probe tag toassess whether a page tag of interest to the user is present in thecaptured tags. For example, local subsystem 110 may evaluate whether theelement in the collected tag record that is associated with the probetag has the same or equivalent identification.

In step 1110, local subsystem 110 may compare the collected tag recordwith the probe tag. Local subsystem 110 may use processes described inconnection with FIG. 8 to normalize the collected tag record and theprobe tag. In additional or alternative embodiments, local subsystem 110may sort the collected tag record prior to comparing to facilitatecomparisons and minimize exhaustion of computer resources. For example,comparing organized records will enable a faster comparison by forexample creating an alphabetical list of elements or to divide searchtasks in parallel processors. In some embodiments, the comparisonbetween the probe tag and the collected tag record may be implementedwith specialized hardware. For example, the comparison may be done withan FPGA or complex programmable logic device (CPLD) specificallyprogrammed to compare the two data sets.

In step 1112, local subsystem 110 may display a list of collected tagsassociated with the selected graphical icon. For example, localsubsystem 110 may generate a graphical user interface, such as the onedescribed in FIG. 13, that shows a list of collected tags and isassociated with a selected icon. The selected icon may represent thatthe page tag matches the probe tag, that a value is not matching but theidentification is matching, or that the page tag is irrelevant for theprobe tag specified by the user.

FIG. 12 is an exemplary flow chart illustrating a graphical userinterface generation process, consistent with disclosed embodiments. Insome embodiments, process 1200 may be implemented by local processor 230in local subsystem 110. However, other elements of system 100 mayadditionally implement process 1200.

Process 1200 may initiate at step 1202, with local subsystem 110receiving a probe tag for analysis to test the website. In someembodiments, process 1200 may be implemented as a forensic analysis ofchanges to a website. For example, process 1200 may be executed afterchanges have been implemented.

In step 1204 local subsystem 110 may determine whether the probe tag foranalysis is present in a list of collected tags. For example, localsubsystem may implement searching processes, like the ones described inconnection with FIGS. 9 and 10, to determine whether the probe tag foranalysis is present in a list of collected tags.

In some embodiments, local subsystem 110 may determine whether the probetag is present by retrieving from database 180 a probe tag property,identifying matches between collected properties and the probe tagproperty; and generating a uniform resource identifier for eachcollected tag that is associated with a collected property that matchesthe probe tag property. The probe tag property may be a value for theprobe tag. In many scenarios it is less burdensome to look for aspecific value rather than the identifier of a page tag. For example,looking for a numeric value in a list of may be easier than looking forthe identification because it would relax requirements of generating anumeric search record (see step 902, FIG. 9). These reductions in stepswould improve the computer functionality by minimizing the number ofoperations that the computer needs to purse. Such improvement may becritical when a very large number of page tags is being analyzed.

When the local subsystem 110 determines the probe tag for analysis isnot present in the list of collected tags(step 1204: no), it maycontinue to step 1206 and generate a user interface with an errormessage. The user interface may include a graphical error icon thatfacilitates reading of a report. The user interface may additionallydisplay a reporting pop-up message including the probe tag, thebenchmark value associated with the probe tag, and a notificationmessage. However, when the local subsystem 110 determines the probe tagfor analysis is present in the list of collected tags (step 1204: yes),local subsystem may then identify a matching collected tag in step 1208.In some embodiments, identifying the matching collected tag may includestoring the matching tag in a cache memory or creating a vector withinformation associated with the collected tag.

In step 1210, local subsystem 110 may determine whether the propertyvalue of the identified collected tag matches a benchmark propertyvalue. For example, in step 1210 local subsystem 110 may retrievebenchmark property values from local benchmark record 226 to determinewhether the probe tag value is equivalent to a benchmark value. In otherembodiments, however, local subsystem may request benchmark values fromdatabase 180.

When local subsystem 110 determines the property value does not matchthe benchmarked property value (step 1210: no), it may continue to step1212 and generate a user interface with a graphical warning icon.However, if local subsystem 110 determines the property value matches abenchmark value (step 1210: yes), then local subsystem 110 may continueto step 1214 and generate a user interface with a satisfactory icon. Insome embodiments, the use of specific user interfaces described forprocess 1200, based on matching tags and matching values, improves thecomputer functionality by creating specific icons for different tags andvalues. Instead of creating multiple icons for a plurality of elements,which may stress computer resources, the process 1200 createsindependent icons.

FIG. 13 is an exemplary graphical user interface 1300, consistent withdisclosed embodiments. Graphical user interface 1300 may represent a“Data Grabber” input that is used to execute the process described inFIG. 11. Graphical user interface 1300 may include filtering buttons1302, a search bar 1308, a catalog input 1310, and a catalog button1312. In addition, graphical user interface 1300 may include a reporttable 1350 which may include fields for request identification 1351,status code 1352, address 1353, resource locator 1355, time stamp 1356,tab id 1357, cached value 1358, and acquisition method 1359.

In some embodiments, filtering buttons 1302 may use information in 1308to modified the elements displayed in the report table 1350. Inadditional or alternative embodiments, catalog button 1312 may useinformation in catalog input 1310 to modify the elements displayed inthe report table 1350.

Report table 1350 may be a coded list, in which each one of the elementsis associated with a graphical icon. The selection of the associatedgraphical icon may be based on one of the fields for each element in thetable. For example, the graphical icon may include a color font for theelement. Thus, an element with type image may highlighted with a redcolor while an element of report table 1350 with type text may have ablue color. Other icons such as warning signs, error signs, or checksigns may also be associated with each element in a coded list.

In some embodiments, the request identification may include a serialnumber. For example, the request id may be a consecutive number ofrequests recorded during a session.

In some embodiments, the status code 1352 may include a HypertextTransfer Protocol (HTTP) response status codes. For example, status code1352 may include:

Code type Sample Code 1xx Informational 100 Continue 101 SwitchingProtocols 102 Processing: (WebDAV) 2xx Success 200 OK; 201 Created; 202Accepted; 203 Non-Authoritative Information; 204 No Content; 205 ResetContent; 206 Partial Content; 207 Multi-Status (WebDAV); 208 AlreadyReported (WebDAV); 226 IM Used; 3xx Redirection 300 Multiple Choices 301Moved Permanently; 302 Found; 303 See Other; 302 Found; 303 See Other;304 Not Modified; 305 Use Proxy; 306 (Unused); 307 Temporary Redirect;308 Permanent Redirect (experimental)

Code type Sample Code 4xx Client Error 400 Bad Request, 401Unauthorized, 402 Payment Required, 403 Forbidden, 404 Not Found, 405Method Not Allowed, 406 Not Acceptable, 407 Proxy AuthenticationRequired, 408 Request Timeout, 409 Conflict, 410 Gone, 411 LengthRequired, 412 Precondition Failed, 413 Request Entity Too Large, 414Request-URI Too Long, 415 Unsupported Media Type, 416 Requested RangeNot Satisfiable, 417 Expectation Failed, 422 Unprocessable Entity(WebDAV), 423 Locked (WebDAV), 424 Failed Dependency (WebDAV), 425Reserved for WebDAV, 426 Upgrade Required, 428 Precondition Required,429 Too Many Requests, 431 Request Header Fields Too Large, 444 NoResponse (Nginx), 449 Retry With (Microsoft), 450 Blocked by WindowsParental Controls (Microsoft), 451 Unavailable For Legal Reasons, 499Client Closed Request (Nginx), 5xx Server Error: 500 Internal ServerError, 501 Not Implemented, 502 Bad Gateway, 503 Service Unavailable,504 Gateway Timeout, 505 HTTP Version Not Supported, 506 Variant AlsoNegotiates (Experimental), 507 Insufficient Storage (WebDAV), 508 LoopDetected (WebDAV), 509 Bandwidth Limit Exceeded (Apache), 510 NotExtended, 511 Network Authentication Required, 598 Network read timeouterror, 599 Network connect timeout error.

The page tag type 1355 may be defined as an image, text, mouse over,click, or session duration. While the page type 1355 is presented astext in the field, in some embodiments the page tag type 1355 may becodified to minimize complexity of the table and save memory. Forexample, instead of “image” and “text,” page type 1355 may be a “1” and“2” representing the image and text to minimize the table weight.

Acquisition method 1359 may include HTTP methods. For example,acquisition method 1359 may include common methods for HTTP such as GET,HEAD, POST, PUT, DELETE, TRACE, CONNECT. The GET method means retrievewhatever information (in the form of an entity) is identified by theRequest-URI. If the Request-URI refers to a data-producing process, itis the produced data which shall be returned as the entity in theresponse and not the source text of the process, unless that texthappens to be the output of the process. The HEAD method is identical toGET except that the server MUST NOT return a message-body in theresponse. The POST method is used to request that the origin serveraccept the entity enclosed in the request as a new subordinate of theresource identified by the Request-URI in the Request-Line. The PUTmethod requests that the enclosed entity be stored under the suppliedRequest-URI. If the Request-URI refers to an already existing resource,the enclosed entity SHOULD be considered as a modified version of theone residing on the origin server.

FIG. 14 is an exemplary graphical user interface report 1400, consistentwith disclosed embodiments. Local subsystem 110 may generate userinterface 1400, for example, at step 722 of FIG. 7. User interface 1400may be issued by report generator 238.

User interface 1400 may include a summary of matching tags 1402, thatmay also be summarized with a graphical representation 1404.

User interface 1400 may also include a reporting table 1406. Table 1406may include a tag ID 1420, a binary result 1408, a numeric result 1410,a string result 1412, and an hexadecimal result 1414. In addition table1406 may include information of number of “fire events” or number ofnumber of page tag occurrences.

While FIG. 14 presents table 1406 in a graphical user interface, suchembodiment may be substituted with only machine-readable tables. Forexample, when hundreds or thousands of tags are being analyzed, table1406 may be in the form of a Comma Separated Values (CSV) or ExtensibleStylesheet Language Transformations (XSLT) file formatted for machinereading. In addition, as previously explained the table may includecertain elements to assure the quality or improve the computerfunctioning by compressing information.

Another aspect of the disclosure is directed to a non-transitorycomputer-readable medium storing instructions that, when executed, causeone or more processors to perform the methods, as discussed above. Thecomputer-readable medium may include volatile or non-volatile, magnetic,semiconductor, tape, optical, removable, non-removable, or other typesof computer-readable medium or computer-readable storage devices. Forexample, the computer-readable medium may be the storage unit or thememory module having the computer instructions stored thereon, asdisclosed. In some embodiments, the computer-readable medium may be adisc or a flash drive having the computer instructions stored thereon.

It will be apparent to those skilled in the art that variousmodifications and variations can be made to the disclosed remote controlsystem and related methods. Other embodiments will be apparent to thoseskilled in the art from consideration of the specification and practiceof the disclosed remote control system and related methods. It isintended that the specification and examples be considered as exemplaryonly, with a true scope being indicated by the following claims andtheir equivalents

What is claimed is:
 1. A computer system for analyzing page tags of awebsite, the system comprising: a processor in communication with adatabase; and a storage medium storing instructions that, when executedby the processor, cause the processor to perform operations comprising:accessing the website, the website comprising plurality of page tags;generating a collected tag record by aggregating the page tags, thecollected tag record comprising collected elements; requesting, from thedatabase, a benchmark tag record, the benchmark record comprisingbenchmark elements and being based on historic page tags stored in thedatabase; generating a normalized tag record, the normalized tag recordcomprising normalized elements, the normalized elements comprising thecollected elements modified to match a format of the benchmark elements;generating a result tag record, the result tag record indicating atleast one of matches or mismatches between the benchmark tag record andthe normalized tag record; and displaying at least one of the result tagrecord or an analysis result, the analysis result representing anaggregation of the result tag record.
 2. The computer system of claim 1wherein the operations further comprise: compiling a test scenariobefore accessing the website, the test scenario comprising a pluralityof web actions; executing the web actions; and collecting page tags forthe web actions.
 3. The computer system of claim 1, wherein theoperations further comprise filtering the normalized tag record based onthe benchmark tag record by eliminating normalized elements that areinexistent in the benchmark tag record.
 4. The computer system of claim1, wherein: the processor is a first processor; and generating anormalized tag record comprises: generating a numeric search recordbased on the collected tag record, the numeric search record comprisingsearch elements; sorting the search elements; dividing the searchelements into search subgroups, the search subgroups having the samenumber of search elements; and distributing the search subgroups to aplurality of second processors.
 5. The computer system of claim 4,wherein the plurality of second processors comprise a graphicsprocessing unit.
 6. The computer system of claim 4, wherein generating anumeric search record comprises converting character variables of thecollected tag record to numeric variables.
 7. The computer system ofclaim 1, wherein: the processor is a local processor; and the operationsfurther comprise: communicating the result tag record and the normalizedrecord to a supervisor processor; requesting from the supervisorprocessor an authorization to implement a website feature; andtransmitting, to a master server, the website feature upon receiving theauthorization to implement.
 8. The computer system of claim 7, wherein:the local processor is further configured to request, from thesupervisor processor, a feature key: and the supervisor processor isconfigured to generate the feature key when a report analyzer determinesthat the result tag record passed a management test.
 9. The computersystem of claim 8, wherein the supervisor processor is configured togenerate a second result tag record, the second result tag recordindicating at least one of matches or mismatches between the benchmarktag record and the collected tag record.
 10. The computer system ofclaim 1, wherein the processor is connected to a field-programmable gatearray (FPGA) and the FPGA is configured to: receive the collected tagrecord and the benchmark tag record; and return a filtered tag recordhaving only matching elements that appear in both the collected tagrecord and the benchmark tag record.
 11. A non-transitorycomputer-readable medium storing instructions that, when executed by aprocessor, cause the processor to operate a computer system foranalyzing page tags of a website by performing operations, theoperations comprising: accessing the website, the website comprisingplurality of page tags; generating a collected tag record by aggregatingthe page tags, the collected tag record comprising collected elements;requesting, from a database, a benchmark tag record, the benchmark tagrecord comprising benchmark elements and being based on historic pagetags stored in the database; generating a normalized tag record, thenormalized tag record comprising normalized elements, the normalizedelements comprising the collected elements modified to match a format ofthe benchmark elements; generating a result tag record, the result tagrecord indicating at least one of matches or mismatches between thebenchmark tag record and normalized record; displaying at least one ofthe result tag record or an analysis result, the analysis resultrepresenting an aggregation of the result tag record.
 12. Thenon-transitory computer-readable medium of claim 11, wherein theoperations further comprise: compiling a test scenario before accessingthe website, the test scenario including a plurality of web actions;executing the web actions; and collecting page tags for the web actions.13. The non-transitory computer-readable medium of claim 11, wherein theoperations further comprise filtering the normalized tag record based onthe benchmark tag record by eliminating normalized elements that arenonexistent in the benchmark tag record.
 14. The non-transitorycomputer-readable medium of claim 11, wherein the operations furthercomprise: generating a numeric search record based on the collected tagrecords, the numeric search record comprising search elements; sortingthe search elements; dividing the search elements into search subgroups,the search subgroups having the same number of search elements; anddistributing the search subgroups to a plurality of secondaryprocessors.
 15. The non-transitory computer-readable medium of claim 14,wherein the secondary processors comprise a graphics processing unit.16. The non-transitory computer-readable medium of claim 14, whereinoperations for generating a numeric search record comprise convertingcharacter variables of the collected tag record to numeric variables.17. The non-transitory computer-readable medium of claim 11, wherein theinstructions further comprise: communicating the result record and thetest record to a supervisor subsystem processor; requesting, from thesupervisor subsystem processor, an authorization to implement a websitefeature; and transmitting, to a master server, the website feature uponreceiving the authorization to implement.
 18. The non-transitorycomputer-readable medium of claim 17, wherein the operations furthercomprise requesting, from the supervisor subsystem processor, a featurekey.
 19. The non-transitory computer-readable medium of claim 18,wherein the operations further comprise transmitting, to a fieldprogrammable gate array (FPGA), the collected tag record and thebenchmark tag record; and receiving from the FPGA a filtered tag recordhaving only matching elements that appear in both the collected tagrecord and the benchmark tag record.
 20. A computer-implemented methodfor analyzing page tags of a website, the method comprising: accessing awebsite, the website comprising plurality of page tags; generating acollected tag record by aggregating the page tags, the collected tagrecord comprising collected elements; requesting, from a database, abenchmark tag record, the benchmark tag record comprising benchmarkelements, the benchmark tag record being based on historic page tagsstored in the database; generating a normalized tag record, thenormalized tag record comprising normalized elements, the normalizedelements comprising the collected elements modified to match a format ofthe benchmark elements; generating a result tag record, the result tagrecord indicating at least one of matches or mismatches between thebenchmark tag record and the normalized tag record; displaying at leastone of the result tag record or an analysis result, the analysis resultrepresenting an aggregation of the result tag record.